Probability of graphs with large spectral gap by multicanonical Monte Carlo 
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^Abstract 

Graphs with large spectral gap are important in various fields such as biology, sociology and computer science. In 
'designing such graphs, an important question is how the probability of graphs with large spectral gap behaves. A 
method based on multicanonical Monte Carlo is introduced to quantify the behavior of this probability, which enables us 
to calculate extreme tails of the distribution. The proposed method is successfully applied to random 3-regular graphs 
and large deviation probability is estimated. 
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1. Introduction 

Random graphs often appear and have been studied 
jn various fields of natural science and engineering. A re- 
cent interest in their applications is generating expander 
graphs [ij , regular graphs that shows high connectivity and 
homogeneity. Such graphs have important applications in 
.designing networks of computers i], infrastructures Q, 
and real and artificial neurons 0, H | . 

] A way to define and generate expanders is maximiza- 
tion of the spectral gap g, which is defined as the differ- 
|ence between the largest eigenvalue and the second largest 
eigenvalue of the adjacency matrix of a graph. Donetti et 
'al. 0, Q numerically maximized the spectral gap by sim- 
ulated annealing and generated examples of these graphs. 
"However, in designing networks, we are also interested in 
quantitative properties; specifically how the probability 
of large spectral gap graphs behaves when the size A'' of 
graphs increases. 

' In this paper we apply a method based on multicanoni- 
cal Monte Carlo 0, [1] to the calculation of large deviations 
in the spectral gap of random graphs. The method can be 
■regarded as an extension of the method introduced in [§| ; 
m [9| , large deviations in the largest eigenvalue of random 
■matrices are computed by a similar method. 
I Multicanonical Monte Carlo enables us to estimate 
tails of the distribution whose probability is very small 
and cannot be computed by naive random sampling. By 
using the proposed method, we estimate the distribution 
of the spectral gap of random 3-regular graphs and quan- 
tify the probability P{g > ^) that the spectral gap is 
larger than a given ^; when ^ > 0.18, it is shown that 
Pig > C) ~ exp(-A'2$(^)) for large N. 



2. Spectral Gaps 

An undirected graph is described by the corresponding 
adjacency matrix Aij, whose entries are defined by 



A,, 



1 i and j are connected, 
otherwise. 



(1) 



Here we denote eigenvalues of the adjacency matrix by 
{Ai}. In the case of A:-regular graphs, Aij has the trivial 
largest eigenvalue Xi = k, therefore we assume 



fc = Al > A2 > ... > A 



N- 



(2) 



The difference Ai — A2 between the largest eigenvalue and 
the largest non-trivial eigenvalue of Aij is called "spectral 
gap" and takes a non-zero value if the corresponding graph 
is connected. We are interested in tails of the distribution 
of the spectral ga p. In the case of regular graphs, Alon 
and Boppana (see [lO| ) proved an asymptotic lower bound 
of the largest non-trivial eigenvalue A2 as 



liminf A2 > 2%/^ 

N-yoo 



1. 



(3) 



Assuming that the limit exists, this gives an asymp- 
totic upper bound for the spectral gap as limAr^oo g < 
k — 2y/k — 1. Graphs with g > k — 2\/k — 1 are called 
"Ramanujan graphs" 11] . On the other hand, Fried- 
man proved that for fc > 3 and for any constant 
e > "most" random fc-regular graphs have A2 that sat- 
isfies A2 < 2\/k — 1 + e as N ^ 00. These results indi- 
cate that the peak of the distribution of A2 is located near 
2y'k - 1 for large N. Miller et al. ^ studied the dis- 
tribution around this peak using naive random sampling. 
None of these studies, however, discusses extreme tails of 
the distribution of A2 or g, which is the main subject of 
this paper. 
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3. Methods 

Here, we will give a brief explanation of multicanonical 
Monte Carlo. The aim of this method is to estimate the 
density of states fl{g) defined by 



(4) 



N=16 



N=32 



N=64 



nig)^ / 6igiA)-g)dA, 



where S is the Dirac 5-function and / dA denotes a multi- 
ple integral in the space of matrix A. We define the weight 
by 'w{g) as a function of g, a key quantity of this method. 
When a weight function w{g) is given, we can generate 
samples from the distribution defined by the weight using 
the Metropolis algorithm [13, The essential idea is 

to tune the weight function w{g) so as to produce a flat 
histogram of g. After we find a appropriate weight func- 
tion w* (g) that gives a fiat histogram, an approximate 
value of the density of states is estimated by l/w*{g). To 
obtain this 'w*{g), we modify the weight function step-by- 
step through the Metropolis simulation using the current 
guess of the weight function w{g). There are several ways 
to modify the function 'w{g). Among them, a method pro- 
posed by Wang and Landau is most successful and 
used in this study. For a more accurate estimate of the 
density of states, we calculate a histogram h*{g) by per- 
forming a long simulation with fixed w*{g). Then ri{g) is 
estimated by fl{g) oc h*{g)/w*{g) and the probability dis- 
tribution p{g) of g is obtained by p{g) = ^{g)/ ^g^{g)- 
Practically, we calculate the density p{g) only in a pre- 
scribed interval 5™*" < g < g™"-^ . 

Details of the implementation of the Metropolis algo- 
rithm are as follows. The simulation starts from an arbi- 
trary fc-regular graph with the desired number of vertices 
N . In each step, a candidate A^'^'^ is generated by rewiring 
edges in the way used in [3, d, [13 , where the degree k of 
each vertex is not changed; a pair of links ij and kl that 
satisfy Aij — Aki = l^Aik = Aji = is selected and 
rewired as Aij — Aki — 0, Aik — Aji = 1. Then the spec- 
tral gap g of a candidate is calculated by the Householder 
method and accept/reject decision of the transition from 
the current state A°'''^ to A^™ is made by comparing the 
Metropolis ratio 



a 



wjgjA"--')) 
'w{g{A°''<^)) ■ 



(5) 



with a random number uniformly distributed in (0, 1]. A 
candidate with g = 0, indicating a disconnected graph, is 
always rejected, hence an ensemble of connected random 
fc-regular graphs is sampled. 

4. Results 

Using the proposed method, we estimate the distribu- 
tion of the spectral gap of random 3-regular graphs with 
the number of vertices N < 128. Figure [T] shows graphs 
with the largest spectral gap for N — 16, 32 and 64 found 
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Figure 1: 3-regular graphs with the largest spectral gap found in the 
simulation. 
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Figure 2: The estimated probability density p{g) of the spectral gap 
of random 3-regular graphs. The density at g plotted in the vertical 
axis is obtained from the probability in a small bin around g of a 
fixed width; the values of them depend on the bin width in the right 
tail of the distribution, because discreteness of the spectra becomes 
relevant there. The arrows indicate g = 3 — 2\/3 — 1; graphs whose 
g is above this value are Ramanujan. 



in the simulations. In Figure[5J we show p{g) of random 3- 
regular graphs with the number of vertices 16 < < 128; 
the computational time is 7 hours for A^ = 16 and 251 
hours for N = 128 using a core of Intel Xeon X5365. As 
N increases, the probability density becomes sharper and 
the peak becomes closer to around 3 — 2^/3 — 1 = 0.172, 
which is consistent with a theoretical estimate [l^ and a 
numerical experiment [l3l |. Specifically, the probability of 
graphs with large g decreases drastically for large A^. 

To quantify decreasing rate of the tails of the distribu- 
tion, we define the probability P{g > ^) that g is larger 
than ^ by 



Pig > 



pig) dg- 



(6) 



Here, we assume the probability P{g > g™"-^') is negligibly 
smaller than < 5 < 5™°^). In Figure [U estimated 
P{g > ^)s are shown as functions of A^. For each ^, P{g > 
^) is well fitted by a quadratic functions of A^, when ^ > 
0.18. This result indicates that P{g > ^) decreases for 
large A^ as 

Pig > ^ eM-N'm), (7) 
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Figure 3: Estimated P{g > ^)s are shown as functions of N. Each 
curve corresponds to different values of Data arc well fitted by 
quadratic functions when ^ > 0.18. 
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Figure 4: The rate function <I'(5) is plotted. The inset shows semi- 
log plot of 'I>(5). In the region § > 0.18, exponentially increases 
as g increases, g = 0.18 is the point that $(5) becomes negative. 



where the rate function $(^) is shown in Figure 01 In 
the region ^ < 0.16, P{g > ^) is no longer a monotonic 
decreasing function of N and asymptotically approaches 
to unity for large N. 

5. Concluding Remarks 

A method based on multicanonical Monte Carlo is in- 
troduced to the estimation of large deviations in the spec- 
tral gap of random graphs. By using this method, we 
calculate the distribution of the spectral gap g and the 
probability P{g > ^) for random 3-regular graphs. While 
naive random sampling provides reasonable estimates of 
P{g > ^) only when ^ is around the peak of the distri- 
bution p{g), the proposed method enables us to estimate 
P{g > ^) in a wide region of ^ including extreme tails 
of the distribution. We find that P{g > £_) behaves as 
Pig > C) ~ exp(-iV2$(^)) for large N, when ^ > 0.18. 



Our preliminary results indicate that a similar behavior is 
also seen in the case of random 4- and 5-regular graphs, 
suggesting that it is a general feature of random fc-regular 
graphs. The proposed method can be applied to calcu- 
lations of large deviations in any statics of any ensemble 
of random graphs. In the case of non-regular graphs, the 
spectral gap are defined as the smallest non-trivial eigen- 
value of the Laplacian matrix L 0, @] ; hence we sample 
matrices L instead of A by using multicanonical Monte 
Carlo. 

Recent studies on Gaussian or Wishart random matri- 
ces 3 3 showed that the probability of all eigenvalues 
being negative decreases as ~ exp(— A^^ x const) when the 
size N of the matrices is large. Our results are regarded as 
an extension of these results to the spectral gap of random 
graphs. 
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